global deduplication